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DESCRIPTION  OF  PROGRESS  (JANUARY  -  JUNE  1984) 

i 

Adminialjaibftt 

This  contract  represents  the  contfriuation  of  a  three-year  contract  that  commenced  in  January 
1981  under  the  tWe  "The  Development  of  Representation  Methods  to  Facilitate  Knowledge 
Acquisition  and  Exposition  in  Expert  Systems."  With  the  renewal  of  the  contract  in  January  1964,  we 
have  reversed  the  roles  of  the  principal  investigator  and  co- principal  investigator.  Thus  Professor 
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Mich— I  Qaneasrefo  has  taken  over  primary  reaponatoMty  for  the  contract,  but  Or.  Edward  ShortWfo 
remakie  Involved  aa  co-investigstor  and  director  of  the  explanation  reoaarch  discus— d  below. 


Intmuactbet  axiiimt 


The  eucceeaul  releeae  of  MRS  teat  year  aRowedue  to  turn  our  attentions  at  the  beginning  of  thie 
year  to  more  theoretical  issues,  with  foe  intention  of  implementing  them  later  in  1984.  One  of  the  moat 
obvious  of  these  has  been  the  incorporation  of  uncertain  reasoning  facilities  into  MRS  itself;  the 
mathematics  underiying  this  was  developed  during  the  first  half  of  the  year,  and  the  results  have  been 
implemented  in  several  amait-scaie  applications. 


A  longer  term  project  involves  the  creation  of  facilities  for  the  compilation  of  MRS  programs. 
Work  on  this  has  begun,  andSxoto-compilers^have  been  written  to  handle  the  process  of  drawing 
inference  by  either  backward  or  forward  chaining.  More  theoretical  research  is  under  way  to 
investigate  foe  possibility  of  automatically  determining  at  compile  time  which  of  these  two  methods  is 
the  most  effective  for  a  specific  application. 


'  An#  a! 


Issues  of  runtime  control  have  also  been  studied.  Our  attention  in  this  area  has  been  focussed 
primarily  on  the  problem  of  recursive  inference;  reasonably  effective  methods  have  been  developed 
and  implemented  for  dealing  with  this. 


General  research  has  also  been  undertaken  with  regard  to  the  presentation  of  the  results  of  an 
Al  program,  be  it  MRS  in  particular  or  a  more  general  problem.  Standards  have  been  developed 
whereby  foe  power  and  expressiveness  of  competing  presentation  laiwtages  may  be  evaluated. 

Other  theoretical  work  completed  during  the  past  six  months  has  been  an  investigation  of  the 
oconnections  between  McCarthy’s  circumscription  and  the  other  paradigms  for  non  monotonic 
reasoning,  and  the  development  of  strategies  and  protocols  for  distributing  deduction  between 
several  large  processors.  With  an  eye  toward  an  eventual  development  of  a  learning  facility  within 
MRS,  a  version  space  algorithm  has  been  Implemented,  and  research  begun  on  foe  automatic 
generation  or  exponmems  oy  maenmo.  ^ 
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Explanation  Project 


The  series  of  ONR-supported  projects  dealing  with  explanation  capabilities  for  advice  systems 
has  continued  during  foe  past  quarter.  The  most  mature  work  Is  that  of  John  Kurtz  in  his  system 


Al/MM.  That  program  has  merged  toy  notions  of  causal/mechanistic  reasoning  with  mathematical 
modeMng  and  tha  representation  of  a  physiologic  system.  Hte  dissertation  was  completed  in  June 
1964  and  is  currently  being  printed  lor  dbtribution. 

Greg  Cooper’s  NESTOR  work  is  complete  and  his  dissertation  report  wW  be  completed  by  the 
end  of  the  summer.  That  system  is  novel  in  its  use  of  a  Bayesian  scoring  function  that  avoids  the 
assumption  of  conditional  independence  by  utilizing  causal  knowledge  of  the  domain.  A  branch  and 
bound  search  technique  is  used  to  prune  the  search  space,  and  emphasis  is  placed  on  allowing  the 
user  to  guide  the  system's  hypothesis  generation  and  analysis.  The  "critiquing"  approach  tc 
interaction  is  used,  thereby  placing  an  emphasis  on  explanatory  capabilities.  Much  of  the  past 
quarter  has  been  spent  on  evaluation  experiments  to  determine  the  validity  of  the  scoring  approach 
used. 

Glenn  Rennets’  work  on  the  explanation  capabilities  for  NEOMYCIN  led  to  a  paper  that  ha 
coauthored  with  Diane  Hasling  and  BiH  Ctancey  (see  list  of  publications  below).  Ha  has  now  turned  to 
the  development  of  a  system  that  provides  an  interface  between  a  user  and  a  decision  analysis  tool. 
The  influence  diagram  approach,  described  in  our  renewal  application,  has  been  the  basis  for  this 
developing  work.  Routines  have  been  written  to  permit  graphical  input  of  an  influence  diagram  and  to 
allow  formal  decision  analyses  to  be  generated  from  the  influence  diagram  once  it  has  bean  fuly 
constrained. 

Curtis  Langlotz  continues  to  work  on  the  problem  of  critiquing  for  the  ONCOON  system  as 
described  in  past  reports.  His  paper  on  the  early  critiquing  work  appeared  in  late  1963  (see 
publications  list).  As  the  work  has  transitioned  to  professional  workstations.  Curt  has  turned  to  the 
development  of  a  simulation  environment  that  will  allow  the  system  to  offer  explanations  based  on 
deeper  mechanistic  models  of  physiology  and  drug  action.  We  expect  the  simuttation  system  to  be 
sufficiently  completed  by  the  end  of  the  summer  that  it  will  be  able  to  support  early  experiments  within 
the  ONCOON  domain. 

HnaHy,  although  Shako  Tauji  to  no  longer  at  Stanford,  she  and  Dr.  Shortliffe  are  completing  a 
paper  based  on  her  ONR-supported  work  whan  she  was  a  student  That  paper  should  be  ready  for 
submission  by  the  autumn. 
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PUBLICATIONS 


Geneearoth,  M.R.  "Partial  program”,  Stanford  Univarsity  Heuristic  Programming  Project,  January 
1964 

Oanaaareth,  M.R.  and  Smith,  D.E.  "Controlling  recursive  inference",  Stanford  University  Heuristic 
Programing  Project,  May  1964 

Ginsberg,  M.L.  "Non-monotonic  reasoning  using  Dempster's  rule",  to  be  presented  at  AAAI-84, 
Austin,  Texas,  August  1964 

Ginsberg,  M.L.  "Analyzing  incomplete  information”,  Stanford  University  Heuristic  Programming 
Project,  June  1964 

Ginsberg,  M.L.  "implementing  probabilistic  reasoning",  Stanford  University  Heuristic  Programming 
Project  June  1984 

Greiner,  R.  and  Geneaereth,  M.R.  "The  role  of  abstractions  in  understanding  analogy",  Stanford 
UniversyHeuristic  Programming  Project  April  1964  at  AAAI-83,  Washington,  D.  C., 
August  1963, 


Mackinfay,  J.  and  Geneaereth,  M.R.  "Iplicit  language”,  Stanford  University  Heuristic  Programming 
Project  March  1984 


Mackkilay,  J.  and  Geneaereth,  M.R.  "Expressiveness  of  languages",  to  be  presented  to  AAAI-84, 
Austin,  Texas,  August  1964 

Smith,  D.E.  and  Geneaereth,  M.R.  "Controlling  recursive  inferences",  Stanford  University  Heuristic 
Programming  Project,  March  1964 

Singh,  V.  and  Geneaereth,  M.R.  "A  variable  supply  model  for  distributing  deductions",  Stanford 
University  Heuristic  Programming  Project,  May  1964 


Duda,  R.O.  and  Shortliffe,  E.H.  Expert  systems  research.  Science.  220:261  -268  (1963). 


Langkrtz,  C.P.  and  Shortliffe,  E.H.  Adapting  a  consultation  system  to  critique  user  plans, 
lotamafonal  Journal  al  Man- Machine  Studies  19:479-496  (1963). 

Tauji,  a  and  Shortliffe,  E.H.  Graphical  access  to  the  knowledge  base  of  a  medical  consultation 
system.  Proceedings  gf  AAMSI  Congress  ffi,  pp.  561-555,  San  Francisco,  Ca., 
May  1963. 


Hasling,  D.W.,  Ctancey,  W J.,  and  Rennets,  G.  Strategic  explanations  lor  a  diagnostic  consultation 
system.  International  Journal  of  Man-Machine  Studies  20:3-19 119841. 

Shortliffe,  E.H.  Explanation  capabilities  for  medical  consultation  systems  (tutorial),  Proceedings  gf 
AAMSI  Congress  84.  pp.  193-197,  San  Francisco,  Ca.,  May  1964. 
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Kunz,  J.C.  Use  of  ArtHldai  k— ioenca  and  Sinaia  Malhamitlrs  to  Ana to>  a  Phvalnlnglr  Mnd. u  PhD 
dissertation,  Computer  Science  Department,  Stanford  University,  June  1964. 


Panara/Ranorta  in  Progress: 

Cooper,  G.F.  NESTOR:  A  Comnuter-Baaa d  Madlral  Aid  that  Integrates  fim[  and 

ProbabWaPc  Raaaonjno  (thesis). 

Tsuji,  S.  and  ShortHffe,  E.H.  Graphics  for  knowledge  engineers:  A  window  on  knowledge  base 
management,  (in  preparation). 
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Conteremm  and  Talk! 

Profs.  Genesereth  and  ShortNffe  have  lectured  widely  both  at  Stanford  and  elsewhere  during 
the  last  several  months.  Since  January  1964  the  tails  most  pertinent  to  this  contract  include  the 
following: 

•  M.R.  Genesereth:  "Procedural  hints  in  the  control  of  reasoning”,  Teknowtodga,  Palo 
Alto,  California,  February  1964 

•  M.R.  Genesereth:  "Procedural  hints  in  the  control  of  reasoning",  Camegia-MaWon 
University,  Pittsburgh,  Pennsylvania,  March  1964 

•  M.R.  Genesereth:  "Procedural  hints  in  the  control  of  reasoning”,  Massachusetts  Institute 
of  Technology,  Boston,  Massachusetts,  March  1864 

•  M.R.  Genesereth:  "Procedural  hints  in  the  control  of  reasoning”,  I.B.M.  Coorporatkxi, 

April  1964 

•  M.L  Ginsberg:  "ProbdbMatic  reasoning  using  Dempster's  rule",  SRI  International,  Menlo 
Park,  CaHfomia,  June  1964 

•  B.N.  Groeof:  "An  inequality  paradigm  for  probabilistic  reasoning”,  SRI  International, 

Menlo  Park,  California,  March  1964 

•  B.N.  Groeof:  "Default  logic  and  default  reasoning",  Stanford  University,  Stanford, 
CaHfomia,  May  1984 

•  B.N.  Groeof:  "An  Inequality  paradigm  for  probabilistic  reasoning",  Stanford  University, 
Stanford,  CaHfomia,  May  1964 

•  B.N.  Groeof:  "Default  reasoning  as  circumscription",  Stanford  University,  Stanford, 
CaHfomia,  May  1964 


•  D.E.  Smith:  "Domain  independent  control  of  reasoning",  Computer  Forunv  Stanford  *  - 
University,  Stanford,  California,  February  1964 

•  E.H.  ShortNffe:  Seminar  on  Knowledge  Systems,  The  University  of  Utah,  Sait  Lake  City, 

Utah,  January  1964. 

•  E.H.  ShortNffe:  Annual  Contractors’  Meeting,  Office  of  Naval  Research,  Stanford 
University,  Stanford,  Ca.,  January  1964. 

•  E.H.  ShortNffe:  Seminars  on  Expert  Systems,  Regional  Meetings,  Association  for 
Computing  Machinery,  Colorado  Springs  and  Denver,  March  1964. 

■-  ... 

•  E.H.  ShortNffe:  Tutorial  on  Explanation  Capabilities  for  Expert  Systems,  American 
Association  for  Medical  Systems  and  Informatics,  San  Francisco,  May  1964. 
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SCHEDULE  FOR  NEXT  QUARTER  (JULY  -  SEPTEMBER) 

Introspective  System. 

Many  of  the  projects  begun  earlier  this  year  have  natural  extensions,  and  these  are  exacted  to 
compriae  the  bulk  of  our  resarch  effort  over  the  next  quarter.  Specifically,  the  facilities  within  MRS  for 
inexact  reasoning  will  be  expanded  and  applied  on  a  larger  scale;  the  compilers  already  in  existence 
will  be  expanded,  documented  and  released;  general  issues  involving  the  cost  of  runtime  control  of 
reasoning  will  be  investigated;  and  A  Presentation  Tool  (APT),  the  implementation  of  our  results  on 
presentation,  wiH  be  developed.  We  also  expect  to  consider  the  problem  of  distributing  deduction 
among  many  small  processors,  as  opposed  to  a  lew  large  ones. 

Work  on  the  following  problems  is  also  envisioned:  On  the  theoretical  side,  we  expect  to 
investigate  an  apparent  connection  between  non-monotonic  reasoning  and  the  effectiveness  of 
forward  chaining.  More  practically,  debugging  tools  will  be  developed  for  MRS,  and  a  comparison  wfll 
be  drawn  between  DARTs  implementation  in  MRS  and  the  earlier  MYCIN  program. 
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Explanation  Proiact 

In  the  next  quarter,  we  expect  to  complete  the  foNowing: 

•  John  Kunz's  dissertation  wNI  be  printed  and  distributed  to  ONR  contractors. 

•  Greg  Cooper’s  thesis  will  be  completed  and  submitted  for  printing. 


PROBLEMS  ENCOUNTERED:  none 


DEPARTURES  FROM  PROPOSED  WORK:  none 


ACTION  REQUIRED  BY  THE  GOVERNMENT:  none 


FISCAL  STATUS: 


(1)  Currently  provided  on  contract  since  January  1981:  $696,622 


(2)  Expenditures  and  commitments  ea  of  6/30/84:  $475,461 


(3)  Funds  required  to  complete  work:  $492,919 


Stanford  SPO  Reference  No.:  1 1192-01  -00 


Michael  R.  Geneaereth,  Ph.D.  Principal  investigator 
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